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METHODS AND APPARATUS FOR 

PREPARATIONAND 
ADMINISTRATION OF TRAINING 

COURSES 

Background of Invention 

[0001] The present invention relates generally to improved methods and apparatus for 
development and management of training courses. More particularly, the invention 
relates to advantageous techniques for creating, presenting and managing computer- 
based training courses. 

[0002] Many companies and other organizations have a continuing need for cost- 
effective ways to train employees, which are easy to develop and convenient for the 
employees. This is particularly true in cases in which employees need to be trained in 
order to ensure that they conduct business in accordance with government 
regulations. Failure to comply with such regulations can prove costly to the business 
and can damage the reputation of the business. It is important that employees know 
what regulations are in force, how these regulations affect them and what steps to 
take to insure that they comply with these regulations. 

[0003] 

Training helps to make employees aware of what they need to do, and ongoing or 
periodic and reasonably frequent training and evaluation of employee knowledge 
helps to keep the information fresh so that employees continue to maintain good 
practices. In order to provide ongoing or periodic training, it is highly beneficial to 
make the training inexpensive to the company and convenient for the employee. An 
employee can be expected to be more conscientious about undertaking required 
training if he or she can schedule the training and take advantage of it when desired. 



App_ID=09683375 



Page 1 of 52 



An employee's ability to schedule training also improves the employee's productivity, 
because an employee can schedule training at times when it will not interfere with 
other pressing work. 

[0004] In order to make sure that employees comply with training requirements, it is 
important to be able to administer training so as to correctly identify employees 
requiring training in a particular area, to provide appropriate training to those 
employees at appropriate times, to remind employees when they should undertake 
training and to make sure that employees have completed training as expected and 
that they have successfully gained the knowledge expected from the training. It is 
important to assemble information relating to training and to make this information 
m accessible to managers and other personnel who need to understand what training 

!? activities are going on and how well employees are achieving the results expected 

09 from training. 

ri [0005] It is also beneficial if the course development process and tools used in course 
111 development are relatively easy to understand and use, so that anyone with a sound 

y- grasp of the course material can design a course without encountering undue 

fU obstacles presented by the course development process or the equipment used to 

ifl develop a course. The absence of technical obstacles increases the number of persons 

ft who can develop courses and also tends to increase the quality of courses by relieving 

pressure that might otherwise exist for courses to be developed by persons proficient 
with the course development tools, whether or not such persons have the greatest 
knowledge of the course material. 

[0006] It is also beneficial to provide a central repository for course information and 
student information as it relates to courses, so that course material can be easily 
retrieved, edited and modified, and comments from users and reviewers of the course 
material can be stored in a central location, with comments about a course associated 
with that course. Providing a central repository also allows easy monitoring of student 
compliance with course requirements and progress in completing courses, allowing a 
manager or other responsible person to be notified early in order to insure that a 
student completes courses as scheduled. 

Summary of Invention 
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[0007] A system according to an aspect of the invention includes a central server 
accessible by one or more user computers. The central server hosts a training 
administration module which has access to a user database, a course library and a 
course creation module. The course creation module has access to a template 
database. The training administration module is able to retrieve information from the 
user database and the course library and to assign courses to students, to identify the 
status of students with respect to courses and of courses with respect to students, 
and to retrieve and display information relating to student progress in or completion 
of a course. 

A method according to an alternative aspect of the present invention includes the 
steps of receiving identifying information from a user, upon validation of the 
identifying information, retrieving a user entry identifying the status of the user with 
respect to a set of training administration resources including a user database 
including user information for a plurality of users, a course library including a plurality 
of training courses and course building and administration tools, presenting the user 
with a selection of available profiles, each profile being associated with a user 
function and upon selection by the user of a desired profile, presenting the user with 
tools and resources appropriate to the profile and giving the user access to the user 
database and course library in order to carry out functions associated with the profile. 

|& [0009] A more complete understanding of the invention, as well as further features and 
advantages of the invention, will be apparent from the following Detailed Description 
and from the claims which follow below. 

Brief Description of Drawings 

[001 0] Fig. 1 illustrates a training management system according to an aspect of the 
present invention; 

[001 1] Fig. 2 illustrates additional details of a training administration module illustrated 
in Fig. 1 ; 

[0012] Fig. 3 illustrates a hypertext page providing a login interface to the training 
administration module of Fig. 2; 



[0008] 
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[001 3] Fig. 4 illustrates an introductory hypertext page reached after logging into the 
training administration module of Fig. 2; 

[0014] Fig. 5 illustrates a course creation module according to an aspect of the present 
invention; 

[001 5] Fig. 6 illustrates a hypertext page presenting an introductory interface to the 
course creation module of Fig. 5; 

[001 6] Fig. 7 illustrates a hypertext page presenting summary information for a course 
being created using the course creation module of Fig. 5; 

[001 7] Fig. 8 illustrates a hypertext page presenting a selection of templates for use in 
creating a course; 

Q 

[001 8] Fig. 9 illustrates a hypertext page presenting a template which has been chosen 
W from the selection presented in Fig. 8; 

l si 

0 [001 9] Fig. 1 0 illustrates a completed page which has been created and submitting using 
Ul the course creation module of Fig. 5; 

m [0020] Fig. 1 1 illustrates a hypertext page displaying an examination which is under 

construction after the selection of an examination template which has been chosen 
Q from the selection presented in Fig. 8; 

[0021] Fig. 1 2 illustrates a completed examination page which has been created and 
submitted using the course creation module of Fig. 5; 

[0022] Fig. 1 3 illustrates a hypertext page presented to a user having responsibility for 
reviewing a course; 

[0023] Fig. 1 4 illustrates a hypertext page allowing a reviewer to add and submit review 
notes for a course under review; 

[0024] Fig. 1 5 illustrates a hypertext page presented to a student and showing details of 
courses assigned to the student or for which the student may be eligible to register; 

[0025] Fig. 1 6 illustrates a process of training management according to an aspect of the 
present invention; and 
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[0026] Fig. 1 7 illustrates a process of training course management according to an 
alternative aspect of the present invention. 

Detailed Description 

[0027] Fig. 1 illustrates a training management system 1 00 according to an aspect of the 
present invention. The system includes a central server 1 02 connected to a network 
1 04. The network 1 04 may suitably be a local area network, a public network such as 
the Internet, or a series of networks. For example, the central server 1 02 may be 
connected to a local area network which is in turn connected to the Internet. The 
central server 1 02 is accessible to a plurality of user computers such as the computers 
1 06A-1 06D through the network 1 04. The computer 1 06A may belong to a training 
system manager, the computer 1 06B may belong to an administrator having 
responsibility for creating and managing one or more courses, the computer 106C 
may belong to a reviewer having knowledge of material included in a course and 
therefore having responsibility for reviewing that course and the computer 106D may 
belong to a student employing the system 100 to take a course. The centra! server 
1 02 may communicate with any number of user computers, but for purposes of 
simplicity only the user computers 1 06A-1 06D are illustrated here. The central server 
102 may also communicate with other resources through the network 104 and these 
resources will be described as encountered in the description of the system 100. 

[0028] The central server 1 02 preferably includes a processor 1 08, memory 1 1 0 and hard 
disk 1 1 2, and hosts a training administration module 1 1 6, preferably implemented as 
software. The training administration module 116 employs a course creation module 
1 1 8. The training administration module 1 1 6 authenticates users, retrieves and 
displays user and course information, prepares reports for administrators and other 
responsible persons and invokes the course creation module 1 1 8 for the creation of 
course materials and its assembly into courses. The training administration module 
116, and course creation module 1 1 8 are described in greater detail below. 

[0029] 2 j|| ustrates additional details of the training administration module 1 16 of 

Fig. 2. The training administration module 1 16 has access to a user database 202, 
which includes a user entry for each user. Each user entry preferably includes 
identifying and authentication information for the user, for example a username and 
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password. The identifying information for each user is preferably associated with 
privilege information for the user. The different privilege levels implemented in the 
exemplary system 1 00 are (1 ) student privileges, allowing a user to select and 
complete a course, (2) reviewer privileges, allowing the user to review course content, 
(3) manager privileges, allowing the user review reports and information relating to 
the training activities of students for whom they have supervisory responsibility, (4) 
administrator privileges, allowing a user to create and enter courses, assign those 
courses to particular students or groups of students and review information relating 
to those courses and (5) training manager privileges, giving the user complete access 
to all elements of and information in the training system 100. Users having reviewer 
or administrator privileges may have these privileges only with respect to certain 
courses, so that particular administrators or reviewers have access only to those 
■ ri courses into which they may be expected to have input. Users having reviewer, 

jfj manager, administrator or training manager privileges also have student privileges to 

Ul all courses to which they have access, allowing them to take courses as students 

y either for learning or to test the course content in a realistic way. In addition, users 

W other than those with training manager privileges may have only student privileges to 

courses for which they do not have oversight responsibilities. 

I 

H [0030] 

*f In addition to identifying information, each user entry may suitably include user 

-it 5 

|& profile information for one or more user profiles assigned to the user. Each user 

preferably has a student profile preferably including information which may be similar 
to that found in a personnel database and may suitably include the name of each user 
as well as other identification, such as network username, email address, telephone 
number and job description information, department in which the employee works, 
and organization to which the cost of the training is to be billed. The job description 
information preferably includes succinct descriptions, such as job function codes, 
which may be easily searched. The ability to search through users by job function 
code makes it easier to determine which students should be assigned a particular 
training course, or to assign training courses to groups of students on the basis of job 
function code, organizational grouping, such as department, or other similar criteria. 
The user database 202 may also include additional identification information specially 
designed for use with the system 1 00 and relating to skills which the student needs 
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and identifying courses or groups of courses useful in developing those skills, and 
which the student may be required to take. The user database 202 may also include 
still further identification information relating to other courses which a student is 
eligible to take. 

[0031] Each student profile also includes identification of all courses assigned to the 

student, along with the student's status with respect to each course, that is, whether 
the course is optional or required, whether the student has started the course, 
whether the student has completed the course, whether the student has successfully 
completed any examinations related to the course and dates relating to various 
milestones for each course, such as the date by which the student must begin or 
complete a required course and the date when a student actually began or completed 
a course. 

[0032] In addition to having a student profile for each user, the user database 202 also 
includes additional profiles for users having higher privilege levels, indicating the 
areas in which the user has oversight responsibilities. These profiles will be discussed 
in further detail below. 

[0033] Once a user has logged into the system 1 00, the training administration module 
1 1 6 allows him or her to select the profile under which he or she wishes to operate, in 
order to see aspects of the system and perform functions available under that profile. 
For example, an user having training manager privileges may have a training manager 
profile, a manager profile, an administrator profile, a reviewer profile and a student 
profile. The training manager can therefore use the system 100 from the perspective 
of every different class of user, in order to evaluate different aspects of the system 
1 00 and identify potential problems affecting a class of user. 

[0034] An administrator profile for a user includes a list of all courses for which the 
administrator has oversight responsibility, a reviewer profile includes a list of all 
courses for which the reviewer has responsibility and a manager profile includes a list 
of all users whose participation in training is supervised by the manager. The manager 
profile may include information identifying the users, typically students, over whom a 
manager has responsibility. This information may come, for example, in the form of a 
list of individual users, a department or job function identification which can be 
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matched against student profiles in order to identify users with a particular manager. 

[0035] The training administration module also has access to a course library 204 for 
storing courses which have been created. The course library 204 includes course 
materials for each course, as well as a status indicator for each course. For example, a 
course may have a status of active or inactive. In such a case, a status of active would 
mean that a course is available for assignment and use, a status of of inactive would 
mean that a course is in the library 204 but is not available because it is being 
developed, because it is being reviewed or because it is unavailable for use by a 
student for some other reason. The training administration module 1 1 6 may suitably 
be designed such that a course having a status of inactive would be visible only to the 
administrator responsible for the course, with the exception that courses having any 
status would always be visible to the training manager or training managers. The user 
database 202 and the course library 204 are presented here as separate entities, but it 
will be recognized that the user information and course information may be stored 
and managed according to numerous techniques. For example, the user information 
and course information may be stored in a single database or divided across multiple 
databases. 

[0036] The training administration module 1 1 6 presents a security interface when 

invoked by a user, allowing the user to enter his or her username and password. This 
interface may suitably be presented as a hypertext page displayed in a browser 
window. Upon entry of the username and password, the training administration 
module 116 presents an initial login interface reflecting one of the user's profiles. The 
initial login interface may include commands available to the user and information 
relating to the profile under which the user is operating. For example, if a user has 
selected the use of his or her administrator profile, the interface may suitably list all 
courses for which the user is responsible, with commands available for use with those 
courses. The interface also presents a mechanism for selecting a different profile, as 
well as mechanisms for executing additional commands. 



[0037] 



If a user has selected the use of his or her reviewer profile, an interface is 
presented listing all courses for which the reviewer has responsibility, along with 
commands relating to those courses. The interface also presents a mechanism for 
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selecting a different profile, as well as mechanisms for executing additional 
commands. The reviewer profile allows the reviewer to see the course in the same way 
that it is seen by a student, and to attach comments to the course. Multiple reviewers 
may have reviewer responsibility for a course, so that comments can be received from 
a number of different perspectives. 

[0038] If a user has selected to use his or her student profile, or has only a student 

profile, an interface is presented listing all courses available to the user, along with 
information relating to each course. The interface also presents a mechanism for 
selecting a different profile, as well as mechanisms for executing additional 
commands. 

[0039] Fig. 3 illustrates a browser window 300 displaying a hypertext page 302 
presented by the training administration module 116. The hypertext page 302 
presents a security interface used to provide username and password information for 
login to the system 1 00. The hypertext page 302 includes username and password 
fields 304 and 306, as well as a button 308 for submission of the login information. 
The page 302 also includes a first hypertext link 310 to be activated when a user 
wishes to change his or her password and a second hypertext link 312 to be activated 
when a user has forgotten his or her password. The hypertext page 302 also includes 
welcoming text 314, explaining some of the features of the system 100. 

[0040] Fig. 4 illustrates the browser window 300 displaying a hypertext page 402, 

reached upon successful login using the page 302 of Fig. 3. The hypertext page 402 
presents information appropriate to the administrator profile of a user, including 
course entries 404-41 2, each of the course entries 404-41 2 including a course 
description and commands associated with the course. The commands 414A-414D 
relate to the course entry 404 and the commands 41 6A-41 6E relate to the course 
entry 41 0. Commands relating to the course entries 406, 408 and 41 2 are similar to 
the commands 414A-414D and will not be discussed further herein in order to avoid 
repetition. 

[0041] The hypertext page 402 also includes a profile selection box 41 8 and an 

activation button 420 for activating a profile selection. The hypertext page 402 also 
includes command buttons 422-432. 
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[0042] The commands 41 4A-41 4D relate to the course description 404, which describes 
a course which is active and available for use. Activating the Information command 
41 4A retrieves summary information about the course. Activating the Link 
Departments command 41 4B allows the course to be linked to selected departments, 
that is, to automatically assign the course to users in the selected departments. This 
allows training to be targeted to students who are more likely to have job functions 
relating to the training, without a need to specifically assign training to what may be a 
large number of individual students. Activating the Deactivate command 41 4C 
deactivates the course, thereby rendering it unavailable for assignment or use. 
Activating the Send Emails command 414D sends email messages to users to whom 
the course is assigned, notifying them that the course is assigned to them and 
directing them to complete the course by a specified date, as well as an email to 
managers supervising the employees, notifying the managers that the course has 
been assigned to their employees and providing details of the assignment, for 
example expected start date and completion date. The Send emails command 41 4D 
also directs the system to send a reminder email to all employees who have not 
completed a course by a predetermined number of days before the due date. The 
training administration module 1 16 is designed such that activating the Send emails 
command 41 4D sends emails only to users who have never before received the 
identical email. This allows new users to be added to a course, and the Send Emails 
command 41 4D to be activated to send emails to those users, without automatically 
sending emails to all users who have already been assigned to the course and who 
have already received emails relating to the course. 

[0043] The commands 41 6A and 41 6B are identical to the commands 414A-414B. The 
Reviewer Notes command 41 6C retrieves notes entered by a reviewer. The Edit 
command 41 6D invokes the course creation module 1 18 to retrieve the course 
contents and allow editing of the course contents. The Activate command 41 6E 
activates the course, making it available for assignment and use. 

[0044] j n ac |djtjon to the commands related to specific course entries, the page 402 also 
includes commands not related to any specific course entry, but useful for obtaining 
needed information and accomplishing necessary tasks. The Home command button 
422 returns the user to the hypertext page 402. As will be discussed in greater detail 
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below, activation of commands on the page 402 may invoke different modules and 
cause navigation to different pages, but a command button similar to the button 422 
will be present on these pages and will cause return to the page 402. 

[0045] The Create Course command button 424 invokes the course creation module 1 1 8 
to create a new course. The operation of the course creation module 1 1 8 is discussed 
in greater detail below in conjunction with the discussion of Fig. 5. 

[0046] The Edit Employee command button 426 allows editing of user information for a 
selected user, typically a user who is assigned as a student to a course for which the 
administrator is responsible. Activation of the button 426 allows access to the user 
database 202, allowing the administrator to review student information, to correct 
y erroneous entries and to update entries in order to keep the data current, for example 

CO by removing users who have left the company or changing the departmental 

hi association for user who have transferred to a different department. 

^ [0047] The Employee Enrollment button 428 allows the administrator to enroll individual 
3 * students or to remove them from enrollment. Typically, students are assigned to 

J* courses by department, job function, or other group, but circumstances may exist in 

ill 

j*& which students need to be individually assigned to or removed from courses, for 

S example if a student joins a department after a course has been linked to the 

F s department. In addition, the Employee Enrollment button 428 is useful for removing 

an employee from a course when that employee's department has been added to a 
course. For example, a sales department may be added to a course, and then the 
Employee Enrollment button 428 may be used to remove the sales department 
secretary from the course, because the secretary does not need to take the course. 

[0048] Pressing the Employee Enrollment button 428 allows the administrator access to 
the user database 202 for the purpose of changing the status of a student with 
respect to one or more of the courses for which the administrator has responsibility. 
The administrator is presented with a listing of students, identifying those students 
who are enrolled in a course, and students who are not enrolled but are available to 
be enrolled. The administrator may then select a student from the list and change his 
or her enrollment status with respect to the desired course. 
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[0049] The Course Completion button 430 allows the administrator to mark a user as 

having completed a particular course, altering the user information to show the course 
as overridden, whether or not the user has actually completed the course. This 
function allows the administrator to exempt students from courses when they have 
met the training requirements in some other way. 

[0050] The Reports button 432 causes the course administration module 116 to retrieve 
and present relevant information relating to the courses for which the administrator is 
responsible. This information may suitably include the status of each course, for 
example, whether it is active or inactive. The information may also suitably include 
lists of students or groupings of students assigned to a course, deadlines for 
completion of the course for each student or grouping of students, information 
relating to whether or not students are making satisfactory progress in each course, 
for example information about what percentage of students complete the course late 
or fail to pass any associated exams on the first, second or third attempt. Pressing the 
Reports button 432 preferably retrieves a summary list of all courses, with links to 
desired categories of information, with activation of a link causing retrieval of relevant 
information from the user database 202 and the course library 204 and processing 
and formatting of this information. 

[005 1 ] Fig. 5 illustrates additional details of the course creation module 11 8 of Fig. 1 . 

The course creation module 1 1 8 allows an authorized user, such as an administrator, 
to create a course, suitably in the form of a sequence of hypertext pages. The course 
creation module 1 1 8 includes a document editor 502 having access to a course 
template database 504 including a set of preformatted templates, as well as a course 
content database 505, including elements which may be retrieved for incorporation 
into a course. Elements in the course content database 505 may include text, 
graphics, audio or video samples, predesigned software, for example a training course 
purchased from a vendor, or any other content deemed suitable for storing in the 
database 505 for inclusion in courses. 



[0052] 



The course creation module 1 1 8 may suitably be invoked from the training 
administration module 116 by a user having appropriate privileges, such as 
administrator or training manager privileges, and using the correct profile, such as the 
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user's administrator or training manager profile. For example, the course creation 
module 1 1 8 may be invoked when an administrator activates a Create Course 
command, such as the Create Course command button 424 of Fig. 4. When invoked, 
the course creation module 1 1 8 presents an interface allowing the user to enter initial 
course data, including the name of the course and a description, the name of the 
administrator of the course, the name of the reviewer for the course, the type of 
training provided by the course and the number of chapters in the course, as well as a 
required passing score for any examination included in the course. 

[0053] Once the initial data has been entered, the administrator proceeds to the next 
operation, for example, by pressing a next button, and the course creation module 
1 1 8 stores the collected data in a course creation buffer 506 and presents a new 
interface, displaying the data previously entered as well as an outline or framework of 
the course. The interface may suitably display headings for an initial set of chapters 
and sections, along with a mechanism to choose editing of the chapters or sections 
already present and the addition of new chapters or sections. 

[0054] The course creation module 1 1 8 provides the administrator with a way to create 
and edit documents, for example hypertext pages or collections of hypertext pages, 
comprising the course. The course creation module 1 1 8 allows the administrator to 
add, remove or edit chapters or sections and to add documents to or remove 
documents from a chapter or section by making appropriate commands. The course 
creation module 1 1 8 further allows the administrator to organize the order of the 
components of the course, for example to reorder chapters or sections or to establish 
or change the order of documents within a section. 

[0055] Upon an administrator command to add a document, the course creation module 
1 1 8 invokes the document editor 502. The document editor 502 retrieves a selection 
of templates from the course template database 504. The administrator selects an 
appropriate template and the document editor 502 displays the selected template. 
The administrator is then free to edit the template as desired in order to create a 
document having the desired content. The administrator can then set parameters for 
the document, for example by making selections within the template. 

[0056] Once the administrator has selected a template and set parameters for the 
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template, he or she then adds desired material to the template. Added material may 
include text, illustrations, hypertext links to documents or other useful material. In 
order to make the creation of documents easy for administrators who may not be 
familiar with programming techniques or the use of hypertext markup language 
(html), the template typically includes specially designed areas in which the 
administrator may insert material. For example, text to be added to the document can 
be typed or pasted into an area designed to received typed text. An illustration may 
be pasted into an area designed to receive an illustration. The template may also 
include areas designed to receive links to other material. For example, the template 
may provide an area into which a user may type or otherwise insert a pathname or 
hypertext link to a reference document or to training software purchased from a 
O vendor. Once the desired material has been added to the template, the administrator 

§i then chooses to process the creation of the document. The text, illustrations or other 

fl material are formatted and placed in appropriate locations in the document and the 

yj document is stored in the course creation buffer 506. 

- 11 [0057] Once the administrator has created all the documents which include instructional 
|4 material, he or she then preferably uses a document manager 508 to review the 

jpf documents and reorder them as desired. The administrator may then create and add 

tfl sets of review questions, for example by creating a review question document for the 

y= end of each section. The student's answers to review questions are not stored or 

graded, but are intended to reinforce learning in order to prepare for any 
examinations included in the course. The review question document may suitably be 
created in a similar way to other course documents, that is, by selecting a review 
question template and adding desired text where indicated. The administrator places 
review question documents in the desired positions, for example at the end of each 
section or chapter. 

[0058] The administrator may then add an examination to be placed at the end of the 
course, selecting a suitable template for creation of the examination, adding 
questions and alternative answers, indicating the correct answer for each question and 
indicating a passing score for the examination. The administrator then indicates how 
many attempts to pass the examination are to be allowed a student before additional 
attempts are refused. This feature allows the administrator to intervene in the 
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instruction of a student who is having difficulty, rather than to simply allow the 
student to make additional possibly fruitless and frustrating attempts to pass the 
course. 

[0059] It is not necessary to wait until the instructional materials have been prepared 
before creating review questions and examinations, but preparing the question 
materials last makes it easier for the administrator to make sure that the questions 
reflect the instructional material contained in the documents which have been 
prepared. 

[0060] Once all the documents have been created and placed in the correct order, the 
administrator assigns a category to the course, that is, an area of instruction within 
which the course falls. If desired, the system 100 may be designed so that groups of 
students are automatically assigned a course if it falls within a designated category. 
For example, students whose job functions involve processing of mortgage 
applications may automatically be assigned all courses dealing with fair lending 
regulations. The course name, course content, course category, passing examination 
score, number of allowed examination attempts, administrator name and reviewer 
name are stored in the course library 204. 

[0061] Fig. 6 illustrates the hypertext browser 300 displaying a hypertext page 602. The 
course creation module 1 1 8 presents the page 602 as an introductory interface when 
the course creation module 11 8 is first invoked. The page 602 includes fields 604 and 
606 for entry of the course name and course description, respectively, as well as 
selection boxes 608-614, allowing the administrator to make a selection from a list or 
other mechanism for choosing from among alternatives. The page 602 also includes a 
default page check box 616, which the administrator may check or uncheck in order 
to select or deselect the option to use default pages. The page 602 also includes a 
Next command button 61 8, which the user may activate in order to submit the 
entered information and proceed to the next page. The page 602 also includes 
command buttons 620-630, similar in function to the buttons 422-432 of Fig. 4. 

[0062] Fig. 7 illustrates the hypertext browser window 300 displaying a hypertext page 
702 displayed after activation of the Next command button 61 8 of Fig. 6, causing 
submission of the initial course information. The page 702 displays summary 
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information 704 for the course, as well as an initial set of chapter, section and page 
headings, as well as commands relevant to those headings. The headings are 
preferably presented in the form of hypertext links, so that activation of an 
appropriate link will retrieve information associated with the link or will cause the 
execution of a command associated with the link. 

[0063] The chapter and section headings are the heading 706, for chapter 1 ; heading 708 
for section 1 of chapter 1 ; heading 71 0 for page 1 of chapter 1 ; heading 71 0 for 
section 1, page 2 of chapter 1; heading 712 for section 1, heading 714 for section 2 
of chapter 1; and heading 716 for page 1 of chapter 1, section 2. Commands 718A- 
71 8D are associated with the heading 706, and allow for removal of the chapter, 
addition of a new chapter, ordering of the chapter with respect to other chapters and 
addition of a new section, respectively. Activation of the Remove command 71 8A 
removes the chapter from the course creation buffer 506, and removes the chapter 
heading 706 and associated commands. Activation of the Add command 71 8B 
presents a dialog box in which the user may enter a chapter name. Upon submission 
of the chapter name, for example by pressing an OK button in the dialog box, a new 
chapter, empty except for the name, is placed in the course creation buffer 508 and a 
new chapter heading is placed on the page 702. Activation of the Order command 
71 8C opens a dialog box displaying chapter headings and allowing the user to move 
chapters up or down with respect to one another. When the administrator is satisfied 
with the order, he or she presses an OK button and the order is adjusted in the course 
creation buffer 508 and on the page 702. 

[0064] Activation of the Add Section command 71 8D presents a dialog box in which the 
user may enter a section name. Upon submission of the section name, for example by 
pressing an OK button in the dialog box, a new chapter, empty except for the name, is 
placed in the course creation buffer 508 and a new section heading is placed on the 
page 702 as a new section of chapter 1 . 

[0065] The commands 720A-720E are associated with the heading 71 0 and are used to 
work with individual pages. The commands 720A and 720D are similar in operation to 
the commands 71 8A and 71 8C, respectively. 

[0066] The Ac u Page command 720B invokes the document editor 504 to allow creation 
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of a page for the course. When the command 720B is activated, a new hypertext page 
presenting a set of templates is presented, allowing the administrator to retrieve an 
appropriate template and then add content to the template to create a document. The 
administrator is then able to save the document thus created. Further details of 
creation of a page are illustrated in Figs. 8-10 and discussed in further detail below. 

[0067] The command 720C is an Edit Page command and invokes the document editor 
504 in order to add material to or otherwise change the page with which the 
command 720C is associated. 

[0068] The page 702 also includes commands 722-728. The Save Course Information 
command 722 saves the course in the course library 204. The administrator may 
continue working on the course, but activating the command 722 saves the work that 
has been done up until the time the command 722 is activated. The Version 
Information command 724 pops up a dialog box giving the version number or other 
version information relating to the course. The Resources URL command 726 allows 
insertion of a link to external resources which may be retrieved by a student taking 
the course. Activating the command 726 pops up a dialog box allowing entry of the 
link and instructions about where in the course to place the link. The Course FAQ URL 
command 728 allows insertion of a link to a set of questions and answers about the 
course or course material. 

[0069] Fig. 8 illustrates a new browser window 800 displaying a hypertext page 802, 

superimposed over the window 300 displaying the page 702. The page 802 presents a 
selection of templates. The templates are represented by thumbnail sketches 804A- 
804N, each thumbnail sketch being accompanied by explanatory text such as the text 
806 accompanying the sketch 804B. Each thumbnail sketch is also accompanied by a 
selector such as the selector 808 accompanying the sketch 80BA. The hypertext page 
802 also includes a field 81 0 for a name of the course page being created, and Save 
and Cancel buttons 812 and 814, respectively. 

[0070] Fig. 9 illustrates the browser window 800 displaying a hypertext page 902, 

presented after selection of one of the templates presented on the page 802 of fig. 8. 
The page 902 appears superimposed on the page 702. The page 902 presents a 
template selected from the choices presented by the page 802 and includes text 903 
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and an illustration 904. The page 902 is illustrated as being created, with text having 
been added. The page 902 includes a size selector 906, allowing the administrator to 
select an appropriate size for the illustration. The page 902 also includes commands 
908-91 8 for use in editing the page 902 or navigating to other pages. In addition, a 
text entry box 920 is visible, created by selection of the command 720C by an 
administrator and used to enter text to be placed in the page 902. The text entry box 
920 includes a text entry field 922, as well as Save and Cancel buttons 924 and 926, 
respectively. When an administrator adds text to the field 922 and presses the Save 
button, hypertext formatting is automatically added to the text and the page 902 is 
updated to include the entered text along with the hypertext formatting. 

[0071] The Previous Page command 908 and the Next Page command 910 store changes 
made so far to the page 902 in the course creation buffer 506, and retrieve a page 
immediately before or after the page 902. In the case of the page 902, the next page 
would be page 2 of chapter 1 , section 1 , and there would be no previous page, so that 
activation of the Previous Page command 908 would have no result. The Close Window 
command 91 2 stores any additions or other editing results and closes the page 902. 
The Reviewer Notes command 914 retrieves notes entered by a reviewer's review of 
the page. The Add Exercises command 91 6 retrieves a template or other form 
allowing construction of a set of exercises related to the material in the page 902 or 
the page 902 and a sequence of previous pages. The Add Audio command 91 8 
associates an audio file with the page 902, for playing when the page 902 is 
displayed. 

[0072] Fig. 1 0 illustrates a browser window 1 000 displaying the page 902, as presented 
to an administrator after the page has been saved and editing has been finished. 



[0073] 



Fig. 1 1 illustrates the browser window 800 displaying a hypertext page 1 1 00, 
superimposed over the window 300 displaying the page 702. The hypertext page 
1 100 is displayed when the administrator chooses the exam template 804M from the 
selections presented in Fig. 8. The page 1 1 00 is shown here as under construction, 
with a number of questions already composed. The page 1 1 00 includes Previous Page, 
Next Page, Close Window and Reviewer Notes commands 1 1 02-1 1 08, respectively, 
equivalent to the commands 908-91 4 previously discussed. The page 1 1 00 also 
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includes an Add Question command 11 1 0, an Add Top Paragraph command 1 1 1 2 and 
an Order command 1 11 4 for ordering questions which have been created. Activation 
of the Add Top Paragraph command 1112 causes presentation of a text entry box 
similar to the text entry box 920 of Fig. 9. Once the administrator has entered desired 
material, preferably introductory material or instructions, in the text entry box and 
submitted the material, the entered material is formatted and presented in the page 
1100. 

[0074] When the administrator activates the Add Question command 11 1 0, he or she is 
presented with a question entry box and two answer entry boxes. The question and 
answer entry boxes are similar to the box 920 of Fig. 9. The administrator enters the 
text of a question in the question entry box and the text of a possible answer in the 
answer entry box. The user then submits the entries. Once the entries have been 
submitted, the material entered into the boxes is formatted into the form of a 
question and accompanying answer choices, and presented as a question entry in the 
page 1110. For example, the question entry 1116 includes question text 1118, first 
answer text 1 1 20A and second answer text 1 040B. The question entry 1 036 also 
includes an answer selector 1 1 22. In addition, the question entry includes Add Answer 
and Order Answer commands 1 1 24 and 1 126, respectively. Activation of the Add 
Answer command causes presentation of an additional answer text box, and 
submission of the answer text causes the presentation of an additional answer choice 
and appropriate expansion of the answer selector 1 1 22. Activation of the Order 
Answer command 1 1 26 reorders the answer choices. 

[0075] The question entry 1116 also includes a Remove Question command 11 28 for 

removal of the question, as well as first and second Remove Answer commands 1 1 30A 
and 1 1 30B, for each of the first and second answer choices, respectively. Each added 
answer choice will be accompanied by a Remove Answer command. 

[0076] A user may activate the Add Question command 1 1 1 0 as many times as desired. 
Upon activating the command 1 1 10, he or she may follow the procedure described 
above to create new question entries. 

[0077] p jg i 2 illustrates the browser window 800, presenting a hypertext page 1 200. 
The hypertext page 1 200 includes the material in the page 1 1 00, after it has been 
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completed and stored, and as it would appear to a student taking the examination 
presented by the page 1 200. The browser window 800 is shown here as 
superimposed over the browser window 300, which displays a hypertext page 1250 
presented to a student taking the course of which the exam appearing in the page 
1200 is a part. The page 1200 is presented upon activation of a command, preferably 
a hypertext link, included in the page 1 250. 

[0078] Fig. 1 3 illustrates the hypertext browser window 300 displaying a hypertext page 
1302, containing information presented when an exemplary user has selected her 
reviewer profile using the training administration module 1 1 6. The page 1 302 
presents a profile selector 1 304, as well as a Go command 1 306. The page 1 302 
additionally presents a course entry 1 308 including descriptive text, an Information 
command 1 31 0 for retrieving further information about the course, a Review 
command 1312, for starting the course review process and a Finish Reviewing 
command 1314, for concluding review of the course. The page 1 302 also presents the 
Home command 1316, for returning to the reviewer's initial profile selection page and 
the Submit Feedback command 1318, for submitting feedback not related to any 
specific course, typically feedback related to any errors or problems related to the 



resulting from a reviewer's activation of the command 1410 to review the course 
described by the course entry 1408. The hypertext page 1402 includes headings for 
various elements of the course under review, such as the heading 1404. Also visible is 
a browser window 1406 displaying a hypertext page 1408, resulting from a reviewer 
activation of the heading 1404. 

[0080] Also visible is a text entry box 141 0, resulting from a selection to add review 

notes to the page 1 408. The text entry box 1 41 0 includes a text entry field 1 41 2 for 
entering text, such as notes or comments, about the page being reviewed, as well as a 
Save data command 1414 and a Close Window command 1416. Activating the Save 
Data command 1 41 4 associates the text entered in the field 1 41 6 with the page 1 408 
and saves the text in the course library 204. Activating the Close Window command 
closes the text entry box 1410. 



operation of the system 100. 




Fig. 14 illustrates the browser window 300 displaying a hypertext page 1402, 
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[0081] Fig. 1 5 illustrates the browser window 300, displaying an initial hypertext page 
1502, presented upon selection of a particular user's student profile. The page 1 502 
includes course entries 1504-1512. Each of the course entries includes descriptive 
text, accompanying commands and a status indicator. For example, the course entry 
1 512 includes the Information command button 1 514, the Start button 1 516 and the 
status indicator 1518. The status indicator 1518 shows the status of the student with 
respect to the course associated with the entry 1 51 2, in this case, that the student has 
completed the course associated with the course entry 1512. The meaning of each 
status indicator is shown by the key 1 520. 

[0082] When the student presses the Start button 1 51 6, the training administration 

module 1 1 6 retrieves the course from the course library 204 and displays either the 
first page of the course, the last page visited by the student, or a page previously 
bookmarked by the student, depending on the student's previous activity, if any. The 
student follows links and executes commands within the course pages in order to 
continue or complete the course. As the student performs course functions, for 
example viewing pages, performing exercises or taking exams, the results of selected 
functions, for example the taking of an exam and the score achieved, are stored in the 
user database 202. 

[0083] Preferably, the training administration module 1 16 monitors the student's 

activities to insure that the student has actually performed all the activities designated 
as required for the completion of a course. For example, when a student elects to take 
a final examination for the course, the training administration module 1 16 may 
suitably examine the log of the student's activities and refuse to allow the student to 
take the examination if the student has not actually viewed every page of the course. 

[0084] 

The page also includes the commands 1 522-1 532, which are not related to any 
specific course. The Home command 1 522 is always visible to the student and its 
activation returns the student to the screen 1 502. The Submit Feedback command 
1 524 opens a dialog box allowing the student to submit comments to the training 
administrator. The Course History command 1 526 retrieves course history information 
relating to the student from the user database and displays this information for the 
student. Course history information may suitably include the actual or required start 
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date of a course, the actual or required completion date of a course and the results of 
exercises or exams, for example whether an exercise was completed, whether the 
student passed or failed an exam and the score of an exam or exams. The course 
history is preferably organized by courses, with information for each course being 
presented in summary along with links to more detailed information. 

[0085] The Course Registration command 1 530 displays all courses for which a student is 
eligible to register. Typically, a student is automatically registered for courses to 
which he or she is assigned. However, a student desiring further training may review 
available courses to which he or she is not assigned and register for those courses. 
Preferably, the courses are presented in a scrollable list or similar convenient format, 
with courses for which a student is required to register at the top of the list. Courses 
for which the student is required to register immediately or within a predetermined 
time are preferably highlighted. Summary information is presented about each course, 
along with links to more detailed information. A command to register for each course 
is also presented. When a student selects to register for a course, course information, 
such as a course identification, is stored in the student's profile in the user database 
202, as well as the date of registration. A required completion date, if any, is also 
stored. 

[0086] The Reports command 1 532 retrieves selected information related to the user's 
status in course for which he or she is eligible or registered, and presents a report 
displaying the information. 

[0087] Individual administrators who have created courses using the course creation 

module 11 8 are able to use the training administration module 11 6 in order to assign 
a course to students and to establish criteria to be met for completing the course. The 
course administrator may assign a time period within which the course is to be started 
after being assigned, may assign a time period within which the course is to be 
completed after being assigned and may set a passing score for any examinations 
included in the course. 



[0088] 



Fig. 1 6 illustrates the steps of a process 1 600 for preparing, managing and 
administering training courses according to an aspect of the present invention. At 
step 1602, a user is presented with an identification interface for authenticating the 
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user in order to allow or refuse access to a collection of resources for creation and 
management of training courses and to establish parameters for the user's access to 
the resources. At step 1 604, upon submission and authentication of login 
information, an authorized user is given access to some or all of the collection of 
resources. Depending on the privileges assigned to the user, the resources may 
include student information, course information, information about the relationships 
between students and training courses and resources for creation of training courses. 
The resources immediately available to the user may suitably be associated with a 
particular user function, such as course creation, course review, examination of 
student progress or the like. A user may suitably select a profile associated with the 
function the user wishes to perform, and selection by a user of a particular profile may 
y cause the organization and presentation of resources associated with that function. 

01 For example, a single user may fulfill the roles of manager, administrator, training 

'iti manager or student, as discussed above, and may select one of various user profiles 

in order to gain access to resources appropriate to the selected profile. 

i II 

^ [0089] At step 1 606, upon selection by a user of a profile, resources appropriate to the 
selected role are organized and presented. For example, if a user selects an 

111 

administrator profile, an administrator page may be presented, displaying the training 

<..?% 

courses for which the administrator is responsible, with commands to assign courses 

M 

H to students, review student progress, edit courses, create new courses, or the like. If a 

user selects a manager profile, a manager page may be presented, displaying 
information about the students or other users for which the manager is responsible 
and providing access to tools for reviewing the course assignments and progress of 
those students. If a user selects a reviewer profile, a reviewer page may be presented, 
displaying courses for which the reviewer has responsibility, and providing tools for 
reviewing those courses. If a user selects a student profile, a student page may be 
presented, displaying the courses for which the student has registered or those 
courses which a student is required to undertake or complete, as well as tools for 
reviewing his or her progress. The student page may also provide a mechanism for the 
student to see descriptions of courses for which he or she is eligible but is not 
required to complete and to register for those courses. 

[0090] At ste p -j 6 Qg^ jn reS p 0nse to user commands, selected resources are retrieved and 
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presented and information retrieved, processed and presented to the user in order to 
allow the user to perform desired activities. Activities which may be undertaken may 
include, for example, creation or editing of a course, review of a course, review or 
editing of the status of students with respect to a course, preparation of reports 
providing student status information, taking a course as a student, or any of the 
activities described above, as well as other activities which may advantageously be 
undertaken in order to administer available training courses. 

Fig. 1 7 illustrates a process 1 700 showing additional details of creating and 
administering training courses according to an aspect of the present invention. At 
step 1 702, a user is presented with an identification interface for authenticating the 
user in order to allow or refuse access to a collection of resources for creation and 
management of training courses and to establish parameters for the user's access to 
the resources. The collection of resources may suitably be embodied in a system 
similar to the system 1 00 of Fig. 1 . At step 1 704, in response to entry by a user of 
valid authentication information, the user is presented with a selection of available 
profiles, each profile giving the user access to selected resources. Available profiles 
may suitably include student, administrator, reviewer, manager and training manager 
profiles and a user may be granted the ability to select one or more profiles 
depending on user privileges. In the present example, the user will be assumed to 
have training manager privileges, giving him or her access to all profiles. In this way, 
the process 1 700 can be fully described through the example of a single user. It will 
be recognized, however, that other users may have access to only parts of the process 
1 700, depending on their privileges and the profiles available to them. 

At step 1 706, upon selection by the user of an administrator profile, the user (now 
referred to as an administrator) is presented with an administrator interface, allowing 
the administrator to create courses and to perform various course administration 
tasks, for example, to assign students to courses, to link courses to groups, such as 
departments or other organizations or organizational subdivisions and to obtain 
reports on courses and students. At step 1 708, upon a command by the user to 
invoke a course creation module, the user is presented with a course creation 
interface, allowing the user to enter initial information about a course to be created. 
At step 1 71 0, upon user entry of initial information about the course, a framework for 
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the course is created and the administrator is presented with a further interface 
allowing him or her to add course elements to the course. The course elements may 
suitably be chapters, sections, documents such as hypertext pages or other pages and 
elements such as instructional software. Some course elements may be embedded or 
otherwise included in other course elements. For example, a chapter may include a 
number of sections, which may in turn include a number of documents or other 
elements. At step 1712, upon an administrator selection to add an element to the 
course, one or more subsequent interfaces are presented giving allowing the 
administrator to create and edit the element. The subsequent interfaces may include 
templates presenting a framework for the course element to be created, allowing the 
administrator to add content to the template in order to create the course element. 
The template preferably includes specially constructed areas to simplify the addition 
of content. At step 1 714, upon an administrator selection to order elements in the 
course, course elements are ordered as directed. Ordering may suitably be an iterative 
process, with elements being moved forward or backward with respect to other 
elements, in response to commands and selections by the administrator. This 
movement may occur repeatedly, in response to repeated commands by the 
administrator. At step 1716, upon an administrator command to save a course, the 
course elements are assembled in the order which the administrator has chosen and 
stored in a course library. 

[0093] At step 1718, upon an administrator command to perform an administrative 
activity, the selected task is performed. Tasks may include assigning courses to 
students. A course may be assigned to one or more organizational groups, for 
example departments, or may be assigned to individual students. Additional activities 
may include notifying students of course requirements, furnishing reports relating to 
student progress in a course, such as course completion, deadlines by which students 
must complete courses, or attempts to pass examinations included in courses. Further 
activities include retrieving and displaying reviewer notes relating to a course, or any 
of a number of other tasks which may suitably be similar to those described above in 
connection with the discussion of Fig. 4. 



[0094] 



At step 1 720, upon a user selection of his or her reviewer profile, the user (now 
referred to as a reviewer) is presented with an interface showing the courses for which 
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the user has reviewer responsibility. At step 1 722, upon selection by the reviewer of a 
course, the course is presented to the reviewer from the same perspective a student 
would have upon taking the course. That is, the reviewer is able to page through the 
course and to see the various pages and other elements of the course as they would 
appear to a student. However, each page of the course includes a command to add 
reviewer notes. At step 1 724, upon selection by a reviewer to add reviewer notes to a 
course element, an interface such as a text box is presented, allowing the user to 
enter desired notes. The notes are then received from the user. At step 1 726, upon 
entry by the reviewer of reviewer notes and a selection by the reviewer to save the 
reviewer notes for the element, the reviewer notes for the element are temporarily 
buffered. At step 1 728, upon a reviewer command to save and submit reviewer notes, 
all reviewer notes entered by the reviewer for the course are stored in the course 
library in association with the course, in such a way that they can be retrieved by an 
administrator or other person having administrative responsibility for the course. 

1 [0095] At step 1 730, in response to a user selection of a manager profile, the user (now 
referred to as a manager) is presented with a manager interface showing a list of all 
students whose participation in training is supervised by the manager. At step 1 732, 
in response to selections and commands by the manager, administrative tasks are 
performed relating to some or all of the listed students. The administrative tasks may 
include retrieving and displaying information relating to the course assignments and 
progress of the students, displaying student deadlines for training and sending 
reminders to students in order to remind them to complete training. 

At step 1 734, in response to a user selection of a student profile, the user (now 
referred to as a student) is presented with a student interface presenting a list of 
courses to which he or she is assigned, as well as a selection of commands including a 
command to review other available courses. At step 1 736, in response to a student 
command to review and register for available courses, a list of available courses is 
presented along with commands for registration for selected courses. At step 1 738, 
upon a selection by the student to register for a course, the student is designated as 
enrolled in the course, suitably by an entry in the student profile. At step 1 740, upon 
a student selection of a course in which he or she is enrolled, the course is presented 
and an appropriate page or other element of the course is displayed. The element may 
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be an introductory page if the student is starting the course, or may be the last page 
or element viewed if the student has partially completed the course. At step 1 742, 
upon selections and commands and other entries by the student, selected course 
elements are retrieved and displayed as selected and inputs, such as examination 
answer entries are received and processed. 

[0097] At step 1 744, information about the student's activities, such as actions taken, 
examination scores or a notation that the student has passed the course, is stored in 
association with identifying information relating to the student, for example as part of 
the student profile. This information is available to a party such as an administrator or 
manager having responsibility for the training activities of the student, and can be 
retrieved by such parties as needed, for example in the form of reports described 

% above. 

|j * 

El [0098] While the steps of the process 1 700 have been presented as occurring in 

£ ~ z 

m 

y sequence, it will be recognized that these steps need not all occur every time the 

2 process 1700 is performed, and need not occur in the sequence presented. Instead, 

S £ \ 

s the steps of the process 1 700 may occur in any sequence required, based on the 

needs and choices of the particular user or user for whom the process 1 700 is 
iH* performed at a particular time. 

[J [0099] While the present invention is disclosed in the context of aspects of an 

embodiment employing a specific system and exemplary web pages, it will be 
recognized that a wide variety of implementations may be employed by persons of 
ordinary skill in the art consistent with the above discussion and the claims which 
follow below. 
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